Did you try reversing the polarity of the center speaker to see if it sounds better with the 604's?